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1947 Annual Report Now Available 

B Bac 1947 ANNUAL REPORT OF THE 

Director of the College Entrance Ex- 
amination Board, containing a complete 
account of the Board’s activities for the year 
ending September 30, 1947, is now being 
distributed. 

Of perhaps special interest is the section 
of the Report which describes “Other Serv- 
ices to Member Colleges” besides the cus- 
tomary preparation and conduct of tests. 
For example, charts have just been prepared 
which convert secondary school rank-in- 
class to a convenient standard score. This 
score can be readily weighted and com- 
bined with a candidate’s test scores to pro- 
vide a single predictive index of academic 
success in college. Copies of the charts are 
obtainable, on request, from the College 
Entrance Examination Board, Box 592, 
Princeton, N. J. 

(Continued on page 46) 








Significant Findings from 
April 1947 Examination 





By EpitH M. HuDDLESTON 
Test Construction Department 


F ALL the examinations in the Board’s 
O college-entrance program, the English 
Composition test has perhaps been the cen- 
ter of the greatest debate in recent years. 
Certainly it has presented a great challenge 
to those charged with its development and 
interpretation. The task of the English Com- 
position test is explicit: everyone is agreed 
that it must measure “ability to write” —and 
therein lies the heart of the problem. What 
is ability to write? And, however it is de- 
fined, how can this ability best be measured? 


The Essay Examination 


The traditional essay examination in Eng- 
lish composition relies upon an evaluation, 
by experts, of a work-sample which the stu- 
dent has produced under specified condi- 
tions upon a specified topic. Improvement 
of this technique as a testing device has been 
achieved by systematic experimentation 
with each of the variables involved: the defi- 
nition of the “ability to write,” the kinds of 
subject-matter which may be written about, 
the directions given to the candidate, the 
length and number of the essays to be writ- 
ten in a given examination period, and the 
standards to be used by the experts in eval- 
uating the results. The English essay test 

(Continued on page 50) ; 
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(Continued from page 45) 


Another service of value to colleges, de- 
scribed in the ANNUAL Report, is the pro- 
vision of tests for placement purposes. Such 
tests are available for the foreign languages, 
the sciences, and reading comprehension. 
An undertaking which should be helpful 
both to college admissions officers and to 
high-school principals is the preparation of 
a standard application form for college ad- 
mission. This project is in process. 

In order to maintain and strengthen the 
Board’s understanding of the problems both 
of its member colleges and the secondary 
schools, numerous educational conferences 
were attended and a variety of educational 
institutions were visited. 


The ANNUAL Report contains fuller descrip- 
tions of the activities mentioned above, as well 
as of other activities. Copies of the ANNUAL 
Report may be obtained at fifty cents each 
from the College Entrance Examination Board, 
425 West 117 St., New York 27, N. Y. 





Binders for ‘Review’ Still Available 


Copies of THE CoLtitece Boarp Review 
can conveniently be filed in a loose-leaf 
binder made especially for this purpose. A 
new supply of such binders is now avail- 
able, at cost, from the College Entrance 
Examination Board, P.O. Box 592, Prince- 
ton, N.J. The price is $2.00. 
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TURNER 
Henry CHAUNCEY 


Director and Treasurer of the College Entrance 
Examination Board, and President of the 
Educational Testing Service 


R. Henny CHAUNCEY was appointed Di- 

rector and Treasurer of the College En- 
trance Examination Board in October, 1946. 
Mr. Chauncey’s contact with the work of the 
Board has been extensive and stimulating. While 
at Harvard, he helped to develop the Board's 
objective scholarship tests; he served the Board 
also as consultant in social studies, as member 
and Chairman of the Advisory Committee on 
Problems and Policies, and, during the war, as 
Associate Director of the Army-Navy College 
Qualifying Test Program. In 1945 he left Har- 
vard, where he was Chairman of the Committee 
on Scholarships and Assistant to the Dean of 
the Faculty of Arts and Sciences, to accept ap- 
pointment, successively, as Associate Secretary 
of the Board, Acting Executive Secretary, and 
Director and Treasurer. 

At the first meeting of the Board of Trustees 
of the Educational Testing Service, Mr. Chaun- 
cey was elected President of the new organiza- 
tion. He continues temporarily to serve also as 
Director and Treasurer of the College Entrance 
Examination Board. 


GrorcE W. MULLINs, 
Chairman of the Executive Committee 




















INTERPRETING SCORES ON THE FOREIGN-LANGUAGE TESTS 


Scores on Different Languages Now Directly Comparable 
Uniform Adjustment Provided for Years of Secondary School Training 


By LepyarD R TucCKER 
Department of Statistical Analysis 


A N IMPROVED method of reporting scores 


on the foreign-language tests was first 

employed with the December 1947 
series of examinations. College admission 
officers may now compare scores directly, 
language to language; and in interpreting 
the scores, they may more readily take into 
account differences among candidates in 
years of secondary-school training in the 
language. 

For each of the four languages—German, 
Spanish, French, and Latin—the average 
test-score of a normal, representative group 
who have studied a language for two years 
is now 460; for three years, is 520; and for 
four years, is 580. In other words, each year 
of training beyond two will, on the average, 
yield a 60-point rise in score. Thus, the ad- 
mission officer may make a simple adjust- 
ment when comparing students with differ- 
ent amounts of training. For example, if stu- 
dent L has studied Latin two years and his 
score is 460, he is just at the average—for 
students with two years of training. Similar- 
ly, if student S has studied Spanish four 
years and his score is 580, he, too, is just at 
the average—for students with four years of 
preparation. Student S, of course, knows 
more Spanish than Student L does Latin 
(S having studied the language longer ); but 
in terms of ability to learn the language, S 
and L are equal. 

The present article will discuss the method 
by which this new scoring method was de- 
veloped, and will show the reasoning upon 
which it is based. It should be noted that 
this method applies only to the four lan- 
guage tests upon which the necessary data 
are available in sufficient quantity; a sepa- 
rate problem is presented by the Greek and 
Italian tests, offered for the first time in 
April 1948. 


Correction for Scholastic Aptitude Test 
Differences between Groups 

Scores reported by the College Entrance 
Examination Board are adjusted so that the 
average score of a representative group of 
candidates is 500, with a range of scores trom 
200 to 800. An early observation was that 
the group taking the examination in any one 
of the languages was not typical of the en- 
tire group with respect to ability. For ex- 
ample, candidates taking the examination in 
Latin made an average score of about 540 
on the verbal section of the Scholastic Apti- 
tude Test. Therefore, adjustments in scores 
have regularly been made to correct for 
such differences in ability. By this type of 
correction, it is possible to avoid penalizing 
a student who is compared with a relatively 
superior group (such as the group taking 
the Latin test), and to avoid giving an ad- 
vantage to a student who is compared with 
a relatively inferior group. Thus a student's 
corrected standard score on a language test 
represents the score he would theoretically 
have received if the group taking the test 
had been typical of the entire Board popu- 
lation with respect to ability. The full 
Scholastic Aptitude Test (both verbal and 
mathematical sections, appropriately 


weighted ) is now used for this purpose. 


Correction Needed for Group Differences 
in Amount of Training 
The correction for differences in ability 
between groups was not, however, sufficient 
to make scores comparable from language 
to language, because the average number 
of years of language-study differs signifi- 
cantly from one group to another. 
The extent of the group differences in 
average length of training is shown in Table 
1. Note that, for each language, over half the 
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TABLE 1 


NuMBER OF ForREIGN-LANGUAGE CANDIDATES 
aT Various LEVELS OF TRAINING 


(April 1945 and April 1946 groups combined ) 


Number of candidates Total 
who have studied the 
language for: 


2091 | 1522 | 213 








French ..... 156 | 1868 | 3455 | 1815 


Latin ....... 82 | 363 | 872 | 1315 





4 
a 
—_| —_—_— 


Total ..... 504 | 4929 | 6800 | 2908 | 14641 





group has had the same number of years of 
training, but that these typical amounts of 
training differ from language to language. 
As indicated by the underlined figures, the 
German and Spanish examinations are most 
commonly taken after two years of training, 
the French examination is most commonly 
taken after three years of training, and the 
Latin examination is most commonly taken 
after four years of training. 


TABLE 2 


AVERAGE SCORES BEFORE CORRECTION FOR 
Group DIFFERENCES IN LENGTH OF TRAINING 


(April 1945 and April 1946 groups combined ) 








Average scores of can- 
didates who have studied 
the language for: 
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Failure of the scoring system to take ac- 
count of these differences in typical amounts 
of training made it difficult to compare lan- 
guage scores, because the average score of 
the group taking a language test is deter- 
mined largely by the average amount of 
training the individuals in the group have 
had. A candidate who has studied Spanish 
for four years has a great advantage, be- 
cause he is being compared with a group 
whose average amount of training is much 
less than his. If this same candidate had 
studied Latin for four years, his advantage 
would be less, because he would then be 
compared with a group whose average 
amount of training would be much closer to 
his own. 

The effect of these differences in training 
upon average scores is shown in Table 2, 
which summarizes the scores which were 
reported for the April 1945 and April 1946 
candidates. These scores were corrected for 
ability differences between groups, but not 
corrected for group differences in average 
length of training. In every case, the aver- 
age score increases with an increase in 
length of training; and these average-score 
differences are interpreted as being due en- 
tirely to group differences in length of train- 
ing. Figure 1 presents the average scores 
graphically. The separation between the 
lines for the different languages in Figure 1 


TABLE 8 


AVERAGE SCORES AFTER CORRECTION FOR 
Group DIFFERENCES IN LENGTH OF TRAINING 
(April 1945 and April 1946 groups combined ) 









Average scores of can- 
didates who have studied 


Language the language for: 


Spanish ...... 


French ....... 











Average Scores 


Years of Training 


Fic. 1. Average scores before correction for group 
differences in length of training. (April 1945 and 
April 1946 groups combined. ) 


is an index of the inadequacy of a system 
which fails to correct for group differences 
in amount of training.° 

The new scoring system takes into ac- 
count these group differences in training, as 
well as differences in ability between groups, 
and thus makes possible a direct compari- 
son between scores in the various language 
tests. The final correction for individual can- 
didates—the adjustment of 60 points for 
each year’s difference in training—must of 
course be made by the college admission 
officer when comparing the scores of can- 
didates with differing training. 


Development of the New Scoring Method 


According to the new scoring system, the 
corrected score reported for a candidate is 
the score he theoretically would receive if 
he were a member of a standard “representa- 
tive” population. This theoretical language- 
test population is defined as one which has: 

a. An average S.A.T. verbal score of 
500 (with a standard deviation of 100). 

b. An average S.A.T. mathematical score 
of 500 ( with a standard deviation of 100). 

c. A length-of-training distribution 
which is similar to the distribution ob- 
tained for the four language groups com- 
bined. (See column-totals in Table 1.) 


* The 1-year averages were considered unreliable 
because of the small number of candidates in these 
groups, and are therefore not given in Table 2 or 3, 





—__— German 
600F _ Latin 


AA Average Gain 





400 


Years of Training 


Fic. 2. Average scores after correction for group 
differences in length of training. (April 1945 and 
April 1946 groups combined. ) 


The results of the corrections made on 
this basis are demonstrated by a compari- 
son of Table 3 with Table 2, and a compari- 
son of Figure 2 with Figure 1. In Figure 2 
the lines have been brought sufficiently 
close to one another to justify direct com- 
parison of scores from language to language. 
The line A—A, representing the general 
trend of the corrected scores, crosses the 
2-year point at 460, the 3-year point at 520, 
and the 4-year point at 580—thus demon- 
strating the average rise of 60 score-points 
for each year of study. 


Summary 


Scores on the four language tests ( French, 
Spanish, Latin, and German) are now re- 
ported by the Board in such a way that col- 
lege admission officers may compare scores 
directly from language to language—for stu- 
dents who have had comparable amounts 
of secondary-school training. For each of 
the four languages, the average test-score 
of a normal, representative group who have 
studied a language for two years is now 460; 
for three years, is 520; for four years, is 580. 
Thus, when two students with different 
amounts of training are to be compared, the 
admission officer may do so by making an 
adjustment of 60 points for each year’s dif- 
ference in training. : 
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Recent Studies of the English Composition Test 
(Continued from page 45) 


has profited from the years of painstaking 
effort devoted to it, but it has begun to ap- 
pear doubtful that we can hope for any 
great additional improvement through fur- 
ther refinement of present techniques. 


New Question Types Tried 

Various methods besides the traditional 
essay test have also been developed for 
measuring the ability to write, and the Com- 
mittee of Examiners in English has been 
alert to the possibilities of these other ap- 
proaches. In the April 1947 test, therefore, 
the Committee decided to include two other 
types of test material (the possible value of 
which had been indicated in pilot studies ), 
and to compare these types with the essay 
type currently in use. The total test was di- 
vided into three 20-minute sections, as fol- 
lows: 


Part I, Objective, containing 45 multiple- 
choice questions. 


Part II, Essay. 
Part III, Paragraph Revision. 


Description of Question Types 

I. Objective. This section contains sentences 
in which certain portions are underlined and 
numbered. Each underlined portion is accom- 
panied by suggestions of several possible ways 
in which that portion might be written. In each 
case the student is asked to decide which of the 
suggested answers is correct, or which sounds 
best in the sentence. Questions of this type have 
been developed which test grammar, punctua- 
tion, sentence structure, and conciseness of ex- 
pression. The following examples will illustrate 
the potentialities of this device: 


The success of any experiment is jeopard- 


ized by inaccuracy one error may invali- 
l . 


date all the conclusions found. 


2 
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1. (1) inaccuracy one 
(2) inaccuracy, one 


(3) inaccuracy, one 


2. (1) found 
(2) which are found 


(3) OMIT 


I wished to go and return on the same day 


for several reasons. 
8 


3. (1) (Leave where it is now. ) 


(2) (Place at beginning of 
sentence. ) 


(3) (Place after “return.” ) 


The answers to the above questions are: 


1. Choice 3 


2. Choice 3 
8. Choice 2 


For a more complete description of the ob- 
jective test, and for additional examples, the 
reader is referred to the BULLETIN oF INFOR- 
MATION, which is obtainable on request from 
the College Entrance Examination Board. 


II. Essay. The candidates were asked to dis- 
cuss, in a single paragraph, a serious error which 
parents may make in the rearing of a child, 
and to indicate the possible consequences of 
this error. Personal experience, or observation 
of friends and acquaintances, was to be used to 
support the opinion given. It was suggested 
that the paragraph be about 150 words in 
length. 


III. Paragraph Revision. Two paragraphs 
were presented which needed “to be rewritten 
in the interest of correctness and good style.” 
The candidate was instructed to rewrite each 
paragraph, making whatever changes he con- 
sidered desirable to produce a smooth, well- 
written, and well-organized piece of work. 





The Group Studied 

The study was designed to take advan- 
tage of the fact that many of the secondary- 
school teachers who serve as “readers” for 
the Board’s English examination have stu- 
dents in their own classes who take the ex- 
amination for college entrance. Forty-four 
groups of candidates, whose teachers were 
in Princeton during the April 1947 reading 
period, form the sample of the present study. 
The presence in Princeton of all the co- 
operating teachers made it possible for all to 
participate in the discussions of the criteria 
to be used in evaluating the various question 


types. 
The Criteria 


In any validity study the establishment of 
appropriate criteria is of first importance. A 
validity-study of a test can do no more than 
tell us the extent to which the test scores 
correspond with another independent evalu- 
ation (the criterion measure) of the abili- 
ties supposedly measured by the test. If the 
test scores have a high correlation with the 
criterion measures, and if the criterion meas- 
ures are themselves accepted as valid me2s- 
ures of the ability being tested, then we say 
that our test is also a valid measure of that 
ability. If we have any reservations as to the 
validity of our criterion measure, then we 
must maintain those same reservations in 
evaluating the “true” validity of the test. 
Thus, any conclusions to be drawn from the 
present study are completely dependent 
upon the nature of the criteria that were 
established. 

The two criteria used in this study —course 
grades and teachers’ ratings—are described 
below. 

Course grades. The English Composition 
test is frequently thought of as a measure of 
past achievement in English courses and as 
a predictor of probable success in future 
English courses. Upon this rationale is based 
the selection of English course grades as a 
criterion. In order to give this criterion the 
maximum stability, average course grades 


were used; for each student, an average was 
obtained of all final grades in English for 
the junior and senior years of secondary 
school. Each final grade, in turn, represented 
a composite of all the work the student had 
done in the course—in both literature and 
writing. The composite nature of these 
grades may be considered an advantage if 
one wishes a measure of success in the total 
English course; it is a disadvantage if one 
wishes a pure measure of ability to write. 
Let us remember also that course grades are 
further influenced by such factors as the 
student's attendance in class, his promptness 
in completing assignments, and special rules 
which a teacher may adopt in marking 
papers —e.g., giving an “F” to any paper with 
two or more spelling errors. 

Teachers’ ratings. This criterion was de- 
veloped in an effort to obtain as “pure” a 
judgment as possible of ability to write. The 
development of this criterion involved (1) 
agreeing upon a definition of “ability to 
write,” (2) achieving common standards as 
a basis for the teachers’ ratings, and (3) 
checking upon the self-consistency of each 
teacher’s ratings. 

The teachers agreed that only the ability 
to write “expository” prose would be con- 
sidered, and that each student would be 
rated according to his performance when 
writing on a subject which was congenial to 
him. Students were not to be rated accord- 
ing to imaginativeness, intelligence, or abil- 
ity to deal with a wide range of subjects. 
This narrows the field considerably: the in- 
tent was to sacrifice a more comprehensive 
definition of writing ability in order to ob- 
tain rating standards which would be under- 
stood by all raters in the same way. It was 
also considered that the restricted definition 
more adequately described that aspect of 
writing ability which is important through- 
out the average student’s college career. 
Leadership for the conferences, based 
upon experience in preliminary exploratory 
studies, was provided by Professor Scott B. 
Elledge of Carleton College, a member of 
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the C.E.E.B. Committee of Examiners in 
English. 

The ratings were done by the rank-order 
method: each teacher arranged his students 
in order of excellence from high to low, so 
that a student's “rating” was actually his 
relative position within his own group. An- 
other set of ratings was made at a later date 
(within a week or two), and the ratings ob- 
tained on the two different occasions were 
averaged to establish the final ratings to be 
used. The two independent sets of ratings in 
all cases showed a high degree of con- 
sistency. a 
Comparative Validities of Question Types 

Comparative validities of the different 
question types were obtained by correlating 
students’ scores on each question type with 
scores on each of the two criteria. The cor- 
relations are presented in Table 1. 

The results are clear-cut. Part I, the ob- 
jective section, has a higher correlation with 
each criterion than does either the essay or 
the paragraph-revision section.* Further, 
the objective section has higher correlations 
with the criteria than has the total test of 
which it is a part. 

What are the implications and limitations 
of these findings? It is obvious that, given 
the tests as they are, the essay and para- 
graph revision sections have added nothing 
to the predictive value of this particular ex- 
amination. Similarly, a full length (60-min- 
ute) test composed either of essay or para- 
graph-revision materials would have mark- 
edly less predictive value than a full-length 
test composed entirely of objective material. 


*In the comparison of the relative validity of 
essay and objective material, the above finding is 
corroborated by the results of a preliminary (un- 
published) study of results obtained from several 
groups of college freshmen. A 50-minute objective 
English test had a correlation of .89 with ratings 
by college instructors of their students’ “ability to 
write,” while a 60-minute essay examination (con- 
taining 3 questions) correlated .34 with the ratings. 
These correlations are based on over 100 cases. 
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TABLE 1 


Vauiprry COEFFICIENTS 
(Number of Students = 768 ) 





Correlation with: 

Parts of English Test Teachers’ | Average 

Ratings Course 

Grades 
Part I, Objective.......... 48 44 
Part II, Essay. .........+++ 35 82 
Part III, Paragraph Revision.| .27 27 
Total English Test Score..| 45 43 


This does net mean, however, that essay or 
paragraph-revision material necessarily has 
less potential or theoretical validity. Of 
course, if it were possible to raise the re- 
liability with which these types are scored, 
the validity would also be raised. Improve- 
ments may also be made in the content of 
any of the sections of the test. In connection 
with the paragraph-revision section particu- 
larly, it seems likely that this question type 
is potentially more valid than is indicated by 
the statistics reported here; paragraph re- 
vision was a relatively new question type in 
April 1947, and the developmental work 
which has been done on it since that time 
is promising. Then, too, we must expect 
that the relative validities of the various 
question types would be influenced by 
changes that might be made in the criteria. 
This is true especially with regard to the 
criterion of teachers’ ratings. Had it been 
possible for the teachers to work together 
longer and more intensively, the ratings 
might have provided a more refined—or a 
qualitatively different—measuring instru- 
ment. 
True Validity Coefficients Higher 

All the correlations between test scores 
and criteria are spuriously low. This is ex- 
plained by the fact that no corrections were 


made in the criterion data for differences be- 
tween groups ix ability-level. This is im- 





e 








portant. It means that a person who ranked 
third in a class of inferior ability was counted 
as having the same rating as a person rank- 
ing third in a superior class of equal size. If 
the purpose of this study had been to obtain 
an indication of the absolute rather than of 
the relative validity of the test, it would 
have been necessary to make a correction 
which would put all the students on the 
same scale with respect to the criterion. This 
can be done statistically, and we e t to 
complete such a correction of die dates in 
the near future. When this is done, we can 
be certain that all the validity coefficients 
will rise—and the new validity coefficients 
will be as fair a measure of the actual validi- 
ties as it is possible to obtain with the data 
at hand. 

For purposes of the present study, how- 
ever, we have assumed that the lack of cor- 
rection for differences in ability affects all 
of our validity coefficients in much the same 
way, and that it is therefore justifiable to 
compare the coefficients with each other. 
But we must remember that the test is ac- 
tually more effective than is indicated by 
the size of the coefficients that have been 


obtained. 


S.A.T. Verbal Test Superior as 
Indicator of Writing Ability 

Since the majority of the experimental 
group had taken the Scholastic Aptitude 
Test as well as the test in English Composi- 
tion, it was possible also to study the effec- 
tiveness of the Verbal section of the S.A.T. 
as an indicator of writing ability.. The cor- 
relation of the S.A.T. Verbal with teachers’ 
ratings was found to be .65, and with aver- 
age course grades the correlation was .46. 
Thus, the S.A.T. Verbal has a higher cor- 
relation with each criterion. than has any 
section of the English test, or even the Eng- 
lish test as a whole. (See Table 1.) 

This is not in itself an indictment of the 
English test. If the S.A.T. Verbal did not do 
a good job of predicting success in college 
courses (including English), it would fail 
in its purpose. What we need to know is: If 


we were to combine English with S.A.T. 
Verbal scores, would we then achieve more 
accurate prediction than is possible on the 
basis of the S.A.T. Verbal alone? In other 
words, does the English test, or any part of 
it, measure any factors underlying writing 
ability that are not already measured by the 
S.A.T. Verbal? 

To answer this question we have em- 
ployed what is known as the multiple-cor- 
relation technique. We have taken each of 
the three sections of the English test sepa- 
rately, and combined it with the S.A.T. 
Verbal in such a way as to determine 
whether or not the addition of the English 
section would significantly increase the 
validity coefficient. The multiple-correlation 
method automatically gives to each of the 
component tests, in each case, its optimum 
weight to produce the maximum coefficient 
of correlation with the criterion. This pro- 
cedure has been followed with each of the 
two criteria. The results are summarized in 
Table 2. 

These data show, first, that the combina- 
tion of any one of the English sections with 
the S.A.T. Verbal raises the validity co- 
efficients only slightly. The S.A.T. Verbal 
alone had a correlation of .65 with teachers’ 
ratings; the addition of the objective English 
section raised this only to .67, and the addi- 
tion of either of the other sections had even 
less effect. In fact, none of these rises is im- 
portant. And with course grades as a cri- 
terion, the results are similar. 

The other coefficients in Table 2 indicate 
the effect upon validity coefficients which 
would be produced by combining any two 
English sections with the $.A.T. Verbal, or 
by combining all three sections with the 
Verbal. In no case is there any significant 
change. 

Implications 

It would be a mistake, from so restricted 
a study, to make final and sweeping con- 
clusions as to the value of the question types 
used in the English test. Important limita- 
tions are imposed by the nature of the cri- 
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TABLE 2 


CorRRELATIONS OF COMBINED PREDICTORS 
WITH CRITERIA® 


Multiple Correlation 
with: 



















Combined Predictors Teachers’ Average 
Course 
Grades 
S.A.T. Verbal and 
Objective English ...... 49 
S.A.T. Verbal and 
BOOS soe okt acc cece sete AT 
S.A.T. Verbal and 
Paragraph Revision ..... AT 
S.A.T. Verbal, Objective 
English, and Essay... ... 49 
S.A.T. Verbal, Objective 
English, and Paragraph 
NE er eee 49 
S.A.T. Verbal, Essay, 
AT 


and Paragraph Revision. . 


S.A.T. Verbal and all 
three English sections. .. . 


* The correlation of S.A.T. Verbal (taken alone) 
with teachers’ ratings is .65, and with course grades 

The sample population here consists of 420 stu- 
dents (from the original group of 763) for whom 
S.A.T. Verbal scores were available. Comparison of 
the group of 420 students with the total sample of 
763 showed no significant or systematic differences. 


teria used and by the character of our sam- 
ple population. Revisions in test material, or 
in scoring methods, would also affect the 
validity of the scores obtained. And the pos- 
sible effect upon the teaching of English re- 
quires consideration in any administrative 
decisions regarding the content of the test. 

The results are meaningful enough, how- 
ever, to raise doubt concerning the nature 
of the contribution of the English test to the 
college-entrance battery. The Scholastic 
Aptitude Test is normally taken by all can- 
didates for whom a measure of writing abil- 
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ity is desired. Any test of writing ability 
should justify its presence in the battery by 
making an improvement in the prediction 
already obtainable from the S.A.T. alone. 

The fact that no such improvement was 
found in this study does not prove the im- 
possibility of such improvement. But it 
at least emphasizes the desirability of a 
more thorough examination of the English 
test, and the need for the development of 
other question types which will, if possible, 
measure those aspects of writing ability 
which are independent of the verbal section 
of the S.A.T. 


Summary 

An investigation has been made of the 
relative usefulness of various measures of 
“ability to write.” The measures included 
the Verbal section of the Scholastic Aptitude 
Test, and the three sections of the April 1947 
English Composition Test—namely, Objec- 
tive, Essay, and Paragraph Revision. 

The two criteria, against which the dif- 
ferent kinds of test material were evaluated, 
were: (1) ratings by secondary school Eng- 
lish teachers of their students’ “ability to 
write” —based upon the restricted definition 
of writing ability agreed upon for purposes 
of this study; and (2) combined course 
grades in English for the third and fourth 
years of secondary school. 

With the group of students in this study, 
the objective section of the English test 
proved more closely related to the two cri- 
teria than were scores on either the essay 
section or the paragraph-revision section. It 
was further found, however, that scores on 
the S.A.T. Verbal predicted scores on the 
two criteria better than did any section of 
the English test; and that no section of the 
English test measured, in significant degree, 
any factors underlying writing ability (as 
defined by the criteria) which were not al- 
ready measured by the S.A.T. Verbal. 

The validity of the findings is limited, of 
course, by the special conditions character- 
istic of this study. The results, however, 











point clearly to the need for the develop- ability, but which will also add to the pre- 
ment of question types which will not only diction obtainable from the S.A.T. Verbal 
be valid for the measurement of writing alone. 
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DATES OF COLLEGE-ENTRANCE EXAMINATIONS 


The College Entrance Examination Board has set the following schedule for its 
series of entrance examinations: 


June 5, 1948 (Saturday) January 15, 1949 (Saturday) 
August 18, 1948 (Wednesday) April 9, 1949 (Saturday) 


The Board’s BuLLETIN oF INFoRMATION, obtainable on request, gives detailed 
information concerniiig the examination-schedule, applications, fees, examination 
centers, and the general nature of the examinations. 

Candidates are urgently advised to obtain and complete their application forms 
early. It takes time for the request for an application blank to reach the Board; it 
takes more time for the application blank and the accompanying BULLETIN OF 
INFORMATION to reach the candidate (these printed materials are normally dis- 
patched by second-class mail); and again it takes time for the completed applica- 
tion blank and fee to reach the Board. Moreover, it is always wise to allow time 
for any special correspondence that may prove necessary. 

The normal closing dates for the receipt in Princeton, N. J]. of completed applica- 
tions and fees are as follows: 

a. For candidates east of the Mississippi River or on either bank of the Mississippi: 
three weeks before the date of the examination. 

b. For candidates west of the Mississippi River or in Canada, Mexico, or the West 
Indies: four weeks before the date of the examination. 

c. For candidates outside the United States, Canada, Mexico, or the West Indies: 
seven weeks before the date of the examination. 

A penalty fee of $3.00 (which should accompany the application ) will be charged 
for applications received later than the normal closing date. 

No applications received in Princeton later than one week before the examination 
date will be accepted. 


Special Notice Regarding Candidates in the Western States, 
Alaska, Hawaii, Australia, and Pacific Islands 


To provide prompter service to candidates, schools, and colleges in certain dis- 
tant areas, the College Entrance Examination Board and the Educational Testing 
Service have jointly opened a Pacific Coast Office. This office, under the direction 
of Dr. A. Glenwood Walker, is located at 2207 Shattuck Avenue, Berkeley 4, Cali- 
fornia; the address for ordinary mail is P.O. Box 775, Berkeley, California. The 
Pacific Coast Office will handle inquiries from the following eleven western states: 


California Idaho Utah Arizona 
Oregon Montana Colorado New Mexico 
Washington Wyoming Nevada 


In addition, the Pacific Coast Office will handle inquiries from Alaska, Hawaii, 
Australia, and all Pacific Islands except Japan and Formosa. 

The Pacific Coast Office will mail out application blanks and the BULLETIN oF 
InrorMATIoN. Candidates for college entrance must, however, send in their com- 
pleted application blanks and fees to the Princeton office of the Board (Box 592, 
Princeton, N. J.). Normal closing dates and penalty fees are as listed in the upper 
half of this announcement. There is no exception to the rule that applications re- 
ceived in Princeton, N. J]. later than one week before the examination date will not 


be accepted. 
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